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ONE-TO-ONE DIRECT COMMUNICATION 

RELATED APPLICATION 

This invention is a continuation of and claims the benefit of co-pendmg U.S. 
Application No. 09/823,460 entitled ONE-TO-ONE DIRECT COMMUNICATION filed 
on March 30, 2001 . the entire disclosure of which is hereby incorporated by reference 
and set forth in its entirety for all purposes. 

FIELD OF THE INVENTION 

The invention relates to a graphical user interface (GUI) of a data processmg 

system. 

BACKGROUND ART 

U S Patent 5,910,797 (PhUips Electronics, attorney docket PHN 15,180), 

incorporated herein by reference, relates to a portable data processing apparatus with an 
integrated screen that displays one or more graphical or other objects. TT>. screen hasa 

gravitation-controlled sensor for measuring a spatial orientation thereof. The apparatus 

has a progrannned data processor tor under control of a predetermined range of spattal 

orientations hnparting a non-stationary motion pattern to a predetermined selechon 

among the objects. The motion can be u«) in the way of a joystick. Eventually it may 

result in off-sereen dumpmg, loading, or transfer of an associated object. A 
predetermmed amount ofthe motion representsatransfer of an associated predetermmed 

object between the screen and a predetermined off-screen device. In this way, inclinahon 
of flte app^ttrs may effect data processing effects per se, even apart fom the movmg 
around ofthe object. Storage, printing, reading from a memory chip card, deletmg o, ,e.t, 
and transmission to a remote data processing device are realizations of this kmd of 
feature In case of text, vertical motion thereof may be organized to represent scrolhng. In 
the latter case even an ongoirrg dialog between two apparatuses of the kind descnbed can 
be maintained. 
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SUMMARY OF THE INVENTION 

The current invention relates to a system of data processing devices for the 
transfer of an electronic object from one device to another. The invention supports the 
unpression that the object gradually disappears from the transmitting device and 
gradually appears at the receiving device. For example, the object is associated with, or 
comprises, a graphical representation. Animation is used to let the representation 
gradually slide beyond the border of the visual portion of a display monitor of the 
transmittmg device, and gradually slide into the visual portion of the display momtor. 
The disappearing representation and the appearing representation can, but need not be the 
same As another example, the sending of the object is associated with the fransmittmg 
device rendering an auditory representation of the object being transferred, and the object 
during receipt is associated with the rendering of a similar or another auditory 
representation at the receiving device. The auditory representations rendered support the 
impression of a gradual transfer of the object from the transmitting device to the 
receiving device at the time of transfer. 

In an embodiment of the invention, communication of the electronic object 
between the devices is controlled by a line-of-sight between the devices. The 
communication can be initiated when the devices are within a short-range of one another. 

Preferably, the transmitting device is a handheld device and comprises an 
orientation sensor to determine the orientation of the device with regard to gravity. The 
orientation of the handheld device is used to let the user confrol the transfer of the object. 
For example, the transmitting device is tilted towards the receiving device so as to mitiate 
the flow of the object to the receiving device as if the object were a liquid, or so as to 
. : cn^ma nf the obicct as if it wcrc an animated being. 

iniliaic uic jump 1115 

Thus the invention provides a highly intuitive user-interface so as to facilitate the 
transfer of electronic objects. Tins can be used, for example, within a game or toy 
context. Also, a small child can easily learn how to manipulate the devices so as to 
transfer e.g., graphical representations. For example, a handheld data processing device 
has a repository of electronic objects, e.g., applets, each specific one of which lets a toy 
fimction or respond in a specific way when installed on the toy. Tlie child can easily 
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p„,s™*e.oyinmitivdymmg*e^hicalfU..ra^ferindica«onasv,sualf.edba^^^ 
TOs gives fte child fte impression of poking the file into fte toy as if it were a hqurd. 
Altematrvely. a tnedical modtoring device using the animation in combmatron 
fl,e file transfer being initiated by tilting can be used by anyone without an intncate 
excursion into a manual on the condrol software or menu selection. 

An implementation of the commmucation protocol uses, e.g, applets tor the 
disappearing and appearing representations when 4e object gets transferred. The relafve 
orientations of the communicating devices as sensed by, e.g.. the gravity sensors conttol 
fte way in which the repr^tions disappear and r«ppear. Alternatively or m 
combination with the applets, a succession of bitmaps gets transferred to give the vrsual 
impression of a smoothly sliding physical object. 

An implementation of the invention uses, e.g, the MPEG4 protocol. MPEG-4 rs a 
st^dardthat addresses thecodingofaudio-visuaKAV) information as individual objects. 

Ms standard relates to a system tor the composition and synchronized play-back of these 

objects. 

to general, the user observes an AV scene that is composed following the design of the 
scene's desi^er. Dep«rding on Are degree of freedom allowed by the designer, the user 
has the option to interact with the scene. Operations that the user can perform mclude, 
e g change the viewingAistening point of the scene, e.g. by navigation through a scene; 
drag objects in the scene to a drfterent position; or trigger a cascade of events by cUckmg 
on a specific object, such as staning or stopping a video stream. The scene navigation 
allowed can be put under control of the gravity sensor for the purposes mentioned above, 
to simulate the flowing or sUding of. e.g, a video cUp from one device to another. 

BRIEF DESCRIPTION OF THE DRAWING 

The invention is explained in fhrther detail, by way of example and withreference 

to the accompanying drawing, wherein: 

Figs.l and 2 are block diagrams of a system in the invention; 

Figs.3, 4, 5 and 6 illustrate the gradual disappearance and appearance of the 
graphical representation during the transfer of an electronic object. 
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Throughout the drawing, same reference numerals indicate similar or 
corresponding features. 

DETAILED EMBODIMENTS 

An aspect of the invention relates to the visual or auditory feedback given to the 
userofdataprocessing device, e.g.,ahandheld, when thedevice transits or receives an 

electronic document, such as a graphics object, that allows user-interaction. The object 
canbe communicated among devices inahighlyintuitivemanner as explained below. 

m ergonomic approach is believed to be highly suitable for, e.g., gaming, educational 

or facilitating purposes or for toys, etc. 

Fig 1 isafunctional block diagram ofadata processing system 100 in the 

invention. Some of the functionalities shown may be implemented sharing the same 
hardware or software components. System 1 00 composes a first data processing dev.ce 
102 and a second data processing device 104. In the example shown, device 102 
functions as the transmitter, and device 104 and the receiver. 

First device 102 comprises a data output 106 for, in this example, the wireless 

transmission of data; a user-interface (UI) 108 with user controls for enabling a user to 
initiate the transmitting ofanelectronicobject via data outputl06;andadisplaymomtor 

llOfor displaying the object oragraphical representation thereof. UI108andmonitor 
no may be combined in a touch screen LCD, for example. Device 102 fiirther composes 
aframe buffer 112, an off-screen memory 114, a microprocessor 116, bus controllers 

118 a graphics controller 120, and a display driver 122. 

A software application run on microprocessor 116 controls the processing of the 

. , .. ... H^~~TTTin8^n«h,iscontrolll8andtranslatedintoassociated 
data, mpui is reccivco uuiii ..^x 

graphical evenu a, momWrllOviacontroUa 120 and driver 122. Frame buff«112.s 
coupled ,0 controller 120 and stores the information content that is at least partly sho™ 
on momtor 110. Off-screen memory 1 14 stores, among other thin^ bitmaps that are 
mapped into frame buffer 1 12 and/or data files that describe the available brtmaps. 
Microprocessor 1 16 controls, in addition to the objecfs displaying, the object's 
animation and the data transmission under software control upon a proper control mput. 



4 



US018037A 



In this example, device .102 also comprises an orientation sensor 124 that supplies 

data representative of the orientation of device 1 02, e.g., with respect to gravity. The data 

supplied by sensor 124 is used to, e.g., initiate the transmission of an electronic object, 

for example, when device 102 is tilted. Also, the data is used to control the rate at which 

the object's graphical representation displayed on monitor 110 disappears from the 

monitor's display screen. The larger the tilting angle of handheld device 102 is, the faster 

is the representation sliding out of view. The tilting can also be used to affect the 
transmission'sdata rate so as to simulate the pouringofaliquidoutofacontamer as IS 

explained below. Orientation sensor 124 comprises, e.g., a gyroscope, an arrangement of 

mercury cells, etc. 

Second device 104, here fimctioning as the receiver, comprises a data input 126 
for receipt of the data. The data is processed under control of a microprocessor 128 that 
via bus control 130 supplies the data to a graphics controller 132. Controller 132 controls 
the displaying of a graphics object, associated with the data, on a display momtor 134, 
using a memory 136, a frame buffer 138 and a driver 140. The processing is user- 
controllable via a UI 142 and, in this example, also via an orientation sensor 144. 
-mough UI 142 and/or sensor 144 the user of device 104 can influence the data 
processing, for example as follows. Device 104 is made receptive to the data from device 
102 through a user-interaction with UI 142. The tilting angle sensed by sensor 144 can be 
used to negotiateadata rate with devicel02, that can be thoughtof as the metaphorof 

communicating vessels. Depending on the data rate negotiated, the graphical 
representation of the object being transferred from device 102 to device 104 slides out of 
view of monitor 110 and into view of monitor 134. 

1 ard 1 '^f^ pommiipicate nreferably in a wireless fashion using, for 

example, RF (e.g., Bluetooth), IR, ulfrasound. 

Fig 1 shows first and second devices 102 and 104 as having similar data 
processing capabilities. That is, devices 102 and 1 04 can both serve as transmitter and 
sender at different times when communicating with one another. A multi-player video 
game can be implemented wherein, e.g., manual dexterity of each user determines 
whether or not a graphical object sent by another player takes possession of the receiver's 



screen. 
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Fig 2 is a diagram of another example of a da« processing system 200 wrtl, first 
device 102 and a third device 202. Device 202 is an apparatus, e.g., a toy, whose 
fi„,c.io„ality is software controllable. Different software applications, e.g applets are 
!:reda.dell02,e.g.,inmemorylUandcanhe selected viaUllOSfortra^ferto 

device 202. F„r«^ple. each application is graphrcally represented in a rnenu to 
Mitatetheselection.Therespective^hroa.repres«ta.,onsillus«ate*ev^^^^ 

^.ctiondities of device 202 when dte associated application is installed. For e ample. 
^ce202ismadeaeomponenttha.c„ntrolsd,eoperationofanapparatusthatresponds 

.„ speech input. Different applications determine different r^ponses to speech .nput 
Device 202 is. for example, a module that can be used with a construction set to ma^ 
^eeoh contiolled model vehicles, robots, etc. Device 202 in this example has an actuator 
rI;.ed.oadriver2C..ha.iscontioll«.bya.ntr„.l«204.C„n.rol,er2«mturn.s 

controUedbyprocessorl28. ,.;.:.„„, 
For a child, it is relatively easy to build a strucurre. or a vetacle. but >. is not 
^,e to pro^ .he electionics to control tite structure. invention allows oontiol 
applications to be literally downloaded into device 202. as display 1 10 ^ves visual 
flack, through the disappearing ^hical representation, about the pro^^s and 
completion of the loading, and orientation sensor deteonines the rate at wtach the 

downloading proceeds. i«.trnt,4r file 

Figs 3-5 niustnte the visual feedback regarding Ure transfer of an electromc file 
fton, device 102 with display monitor 1 10 to device 104 with drsp.ay moniU,r 134 ^e 
visual feedbackhere is tire gradual slidingof an obiect 300 off the screen of momU.r ,10 

and into view on monitor 134. 

-„ . .1 t"'"-^"'-"n)'>rated herein by reference: 

The following uuv;uiuoiiii> «v. e — 

. U S serial no. 09/128.839 (a«omey docket PHA 23.469) filed 8/4/98 for Jan van 
Ee et al for REMOTE CONTROL HAS ANIMATED GUI. This document relates to a 
™>„.e ■:ontio, device for remote control of home theater cuipment. T^e device has a 
display wiU. a touch screen representing a GUI. User-activation of the GUI cau^ rts 
appearance to change. Tire change is effected through animation. Animation ,s *e 
Iniation of movement created by displaying a series of hitinaps. The ammation lets the 
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^ p«ceive tt.e change as a smooft ttan^Hon. Th^ impression is avoided of an 
abrupt confrontation with a new lay-out. 

. u S serial no. 09/635,548 (attorney docket US 0000107) filed 8/10/00 fo, 
Eugene Shteyn e. al., for MOBILE MICRO PORTAL. This document relies to a method 
for en^ling a user of a mobile communication device to recdve a short-range wirdess 
facilitation si^ on me device. A beacon uansmits the facilitating si^aal. Wh» the 
user-sdevice is withinrangeofthebeacon the facilitation stgnalmitiatesassocattngthe 

fadIita«ngsi^«i.haservice.Tl>eini.iati„gle^-n«>onaUytc alerting the user to 
theservice.dependingonauser-profiIe,p«fe.ablys«,redatfl.emobiledev,ce. 
Accordingly, theuser is enabledto get only information about services that are of m,e«s. 
,„ him/her as indicated by the user-profile. If the service associated with the fachtafon 
signal matches the user-profile, the user gets alerted to the service via the device, e^g.. vra 
a text message generated on a display of the commumcation device. If the service does 
no. match Ute profile, the device does not alert the user. Ue alerttng text message c^ be 
generated in a way simUar to paging or SMS (Short Message Service). SMS uses GSM 
communicationandaUowssendingoftextmessagesofupto 160characterston»ob.le 

phones.Preferably,.heusercanpro^.hedevicesotha.he/sheistobealer.edthrough 
an audible si^al if d>e service matches the user's profile. Tins way, dre user does no. 
have to keep an eye on the mobile conrnrunicafion device all the time. Preferably, the 
device can store the facilimion siptals and/or the messages thus received for remeval 
later on. Other mechamsms to aleri the user can be used, e.g.. a visual warmng on the 
mobile communication device or a ta«Ue warning throu^ a vibration un,t m the 
communication device as known fi»m pagers, etc. Accordingly, alerts can be tactile 
.. . . . .„:-.., ,.„,diM-nifl-™«ntmodalities,e.g.,amplimdes or styles, can be 

(vibration), lexi, visum Oi u^ai^- - 

used for different priorities within the current user's context. Tbe context (filur) selecuon 
by the user may well conttol .he modaUty of any alerts as well as what opportnmties ^ 
alerted. Emer^ng wireless PAN/LAN network protocols, such as IrDA, Bluetooth and 
HomeRF, enable mobile devices to become a dynamtc part of a hom^, office- or 
community network. Especially a mobile phone equipped with, e.g., Bluetooth- 
compatible hardwt« and software, can commumcate dire^ly with a local devce an^or 
,<,cal service. In general, each network component can be a service-otfer-pomt (SOP). 
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The network comprises, for example, a home network, an office network, or an 
infrastructure of components in a public place such as a shopping maU, a street, an 
airport, a local town network or community netwotk, etc. Each component has abeacon 
to. transmits or broadcasts a facUitation signal associated wifl> meta- atarelatmgto 
infom-ationcontentorsetvices provided at, or representedby.thecomponentor 

associated with the network. Tbe bea^^n's range is typically short-range as wtth 

Bluetooth. .mor- 1 

. U S patent 6,044,397 relates to providing an interfece facility for MPEG-4 
authoring.bits.reammanipulation, editing and interpretation, resultingin^de^^^ 

bitstreams which are easier to test, check and debug while conforming to the MPEG-4^ 
..andarf. THe specified interfaces can also facilitate gracefiJ de^adation in the face of 
decreased resources by allowing editing of bitstreams. The specified interfaces can also 
allow creation of decodablebitstreamsmresponse to theuser requests either directty or 

indirectly embedded in audiovisual applications, as well as iiiture services. TTie invention 
specifiesabitstr^uninput/outputpackageinthe Javaprogramminglanguageto 

acilitates bitstream encoding and decoding of audio-visual media objects, especially 
when coding uses the MPEG-4 standard. He invention separates fixed length and 
variable length coding, and allows flexibleparsing which ofr«s the potential of 

optimizedimplementationasneededtoaidreal.timeornearreal.timeopera.on. 

.US patent 6,028,866 (attorney docket PHN 15,625) relates to a group of end. 
user appamtuses, such as a game computer or a PDA. that communicate wirelessly. for 
instance via infta-red. In order to inoease the reliabUity of the communication, the end 
apparatuses communicate via a central apparahis. This makes it easier to maintain 

^ . H»r»'«-k""wledgement schemes can be used to increase 

contact. Furtnermore, cuu v^iiti^n^- -^b 

tiie reliability of the communication between an end apparatiis and the central apparams. 
Each end app^atus compnses exec«ion means for execting a group application Dunng 
.he execution, die ^oup application communicates to a corresponding ^up app ication 
in a. leas, one end app^tus. The communication takes place by exchan^g apphcation 
messages. To this end, an end apparatus uses message sending means to send tiie 
application message .o «ie central apparatus. Message receiving means of *e cental 
apparatus r^vetiiemessage. Group resolntionmeansoffliecenttd apparatus 
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determine for which group of end apparatuses the received appUcation message is 
destined The group resolution means use message sending means to transmit the 
received application message to end apparatuses of the group. Message receiving means 
in the end apparatuses receive the message. 

- U.S. patent 5,774,673 (attorney docket PHN 15,352) relates to a data processing 
system that allows an apparatus, such as a computer or a PDA, to establish 
communication between a local application and applications in at least one other 
apparatus. The communication is established when a user of an apparatus triggers 
execution of a section application. An active activation unit invites applications m the 
other apparatuses to join by usingamessage sending unit to transmitabroadcast frame to 

all apparatuses, requesting activation of the selected appUcation. The broadcast frame 
specifies which application is being activated. Tlie active activation unit then determines 
a communication chamiel which corresponds to the application and the selected 
application, stored m storage, is executed by an execution unit. The broadcast frame is 
received by a message receiving unit in other apparatuses. A passive activation unit 
verifies whether the receiving apparatus has an application, which corresponds to the 
specified application and whether such an application needs to be activated. If so, the 

passive activation unit determines which communication chamiel corresponds to the 
application (the same communication chamiel as determined by apparatus) and uses an 
execution unit to execute the corresponding application, which is stored in storage. The 
group of applications, which in this way has been formed, communicates by using group 
frames. The group frames include a chamiel field which identifies a communication 
chamiel. The formed group of applications uses the communication chamiel which 

^ j« 4.^ ^Uf> ooUof^^H 5inn1ir.ation in the apparatus. 

. U.S. patent 5,797,085 relates to a communication system that allows a group of 
at least three apparatuses, such as game computers and Personal Digital Assistants 
(PDAs), to communicate wirelessly by using, for instance, infrared transmission. The 
apparatuses are the same from a communication point of view. A message frame 
transmitted by an apparatus can, therefore, be received by all other apparatuses, which are 
part of the system. ReUability is increased by acknowledging correct reception of a 
message frame and retransmitting a message frame up to a predefined maximum number 
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of «„es if no a«ge»«. ft»e is r^ved. chance of n>essage^an,cs and/or 
acknow.edgen,cn.fran,escolUdingisreduced.Ateamcssageftamchasbeen 

L3n.„e:afoU„w,„gae«ned«™epeHo.i.csc„«ifo,ac^ow,eag.g:^^^^^^^^ 

tt.c message ftamc. Upon receiving .he message ftame, recvrng apparent war. 
™aon.«n.e,wiU.n,he.e«nedpenoOefo.ac.„w.ed,ngT.e«^^^ 
«n.e.n. — an aci^owledgmen. ta,e The o*er apparatuses do no. ^ an 
acknowledgemen. ftame. CorreC reception of a message frame is. Urerefore. only 
acknowledged by one apparams. This is accomplished ftrongh use of ^vo timers. 

. u S Pa« 5.068,646 (attorney docke. PHB ) rela,es u, a ,ech«>,ue or 

achieving read-time animation in bir-map dam displays in apparati. having a drsplay 

,.v«rfi<rital codes to give ttie color and/or lommanoe of 
memory. The display memory stores digitol codes 10 give 

eachpixeloftired,splay.Thedisplaymemoryisaecessedrepea,edlyinarecn.ren. 

C:yscancycle.oread-on..edigi.a,codestoprodnceti.edisplay.T.etim^.^^^^ 

formodi<ying.hecon.en.sof4edisplaymemory.oaehrevean,mati„nofanob^». 

;ains.allaek^»aisverysmallandaecess.o.Hedrsp,ay memory t^^^^^^^ 
1 and for v^ting-in new digi.al codes mus. no. be m conmc A method . tir^fore 
proposed of continnaUy modifymg the display memory content, to achreve object 
LLtion, in which the shape of an object is coded into a madtine code program (e^g, by 
a compiler) before tire display is run and then the machme code pro^ .s used ^a 
L.ro:.nL.hedMay.r„ntomoveti.edatar„rti.eobjectshape<™*^^^^^^ 
^odificationjtodifferentmemory locations ofti-edisplaymemory.wrthtiredata for me 

background areas involved being saved and re-written as the animation progresses and 
the object shape moves over the background. 



10 



